COOPERATIVE BOOLEAN SYSTEMS WITH 
GENERIC ALLY LONG ATTRACTORS II 
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Abstract. We prove that cooperativity in Boolean networks precludes 
a strong notion of sensitive dependence on initial conditions. Weaker 
notions of sensitive dependence are shown to be consistent with coop- 
erativity, but if each regulatory functions is binary AND or binary OR, 

i— N 

in iV-dimensional networks they impose an upper bound of « V3 on 
the lengths of attractors that can be reached from a fraction p « 1 of 
initial conditions. The upper bound is shown to be sharp. 



1. Introduction 

This paper is a continuation of the investigation in [7J of the extent to 
which chaos can be generic in cooperative Boolean networks, where cooper- 
ativity is the absence of any negative interactions whatsoever. The intro- 
duction of [7J gives a detailed discussion of our motivation for studying this 
problem and additional references to related work; here we will repeat only 
some essentials that are needed for understanding the results of this second 
part. 

Cooperativity is a special case of the more general property of monotonic- 
ity, which is defined by the absence of feedback loops with an odd number 
of negative interactions. In monotone flows trajectories converge generically 
towards an equilibrium under mild regularity hypotheses; see e.g., [5} 15} ITT]. 
In particular, this result implies that chaotic trajectories are not generic in 
cooperative continuous flows. Since many natural systems can be modeled 
with several types of dynamical systems, it is of interest to study whether the 
above result on nongenericity of chaos in monotone flows has counterparts 
for Boolean networks. 

Chaotic dynamics of Boolean networks are characterized by very long 
attractors, very few eventually frozen nodes, and high sensitivity to pertur- 
bations of initial conditions [10J. These three hallmarks usually, but not 
always, go together. Our focus in part I [7] was on very long attractors. 
Since the state space of an ^-dimensional Boolean network has size 2^, we 
were interested in upper bounds of the form c N for constants c < 2. As 
in |B] we call an iV- dimensional Boolean network c-chaotic if it does have 
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an attractor of length > c N . If attractors of this length are reached with 
probability > p from a randomly chosen initial condition, then we say that 
the network is p-c-chaotic. Thus p-c-chaos is a notion of genericity of chaos 
in terms of very long attractors, and it also implies genericity of chaos in 
terms of very few eventually frozen nodes (Proposition 3.2. of |7j). 

Expected dynamics of so-called random Boolean networks (RBNs) tends 
to become more chaotic as the number of inputs per node increases (see, 
e.g., the surveys [21 EE)])- The most stringent limitation of this kind is the 
assumption that the Boolean network is bi-quadratic, that is, such that both 
the number of in- and outputs per node is bounded from above by 2. The 
main result of [7] (reproduced below as Theorem 3.1) is that that coopera- 
tive bi-quadratic Boolean networks can still be p-c-chaotic. However, if we 
require that the system is strictly bi-quadratic, that is, all nodes have exactly 
two inputs and two outputs, then even c-chaos is possible only for c < 10 1 / 4 
and the bound is sharp [SJ E] • Here we will show that the same bound holds 
for strictly bi-quadratic p-c-chaotic cooperative networks (Theorem 3.9). 

The main focus of this second part will be the question whether coopera- 
tivity limits to some extent the sensitivity to perturbations of initial condi- 
tions in Boolean networks. All by itself, p-c-chaos does not imply high sensi- 
tivity to initial conditions. In particular, p-c-chaos can coexist in cooperative 
Boolean networks, for every 0<p<l<c<2, with p-coalescence, which 
is the property that for two randomly chosen initial conditions s(0),s *(0) 
that differ by a single-bit flip (have Hamming distance 1) with probability 
> p there will be some t > with s(t) = s*(t). 

There are several plausible ways of formalizing the notion of sensitive 
dependence on initial conditions, and we will study three such notions: p- 
instability, which in cooperative Boolean networks is equivalent to the nega- 
tion of p-coalescence, p-D-decoherence, and p-a-g-decoherence. Intuitively, 
the latter two notions mean that a single-bit perturbation to a randomly cho- 
sen initial condition will with high probability lead to trajectories that have 
a relatively large Hamming distance infinitely often. It turns out that the 
strongest of these notions, p-a-g-decoherence, does occur in some p-c-chaotic 
Boolean networks (Proposition 3.5), but is precluded by cooperativity (The- 
orem 3.6). Thus an analogue of the above mentioned theorem for monotone 



flows does hold for this particular formalization of the notion of chaos in 
Boolean networks. 

For p-instability and p-D-decoherence the situation is more subtle. We 
will show that for every 0<p<l<c<2 there are bi-quadratic cooper- 
ative Boolean networks that are simultaneously p-unstable and p-c-chaotic 
(Theorem 3.2). But str ictly bi-quadratic such networks can exist only if 
c < \/3 (see Subsection 3.2), and we show that this bound is again opti- 
mal (Theorem 3.10). In general, cooperative p-c-chaotic Boolean networks 
can exhibit arbitrarily strong forms of p-L>-decoherence (Theorem 3.7). We 
prove that some versions of this property can occur under the additional 
assumptions that the network is bi-quadratic (Theorem 3.8) or even strictly 
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bi-quadratic (Theorem 3.11). It remains an open problem to determine the 
maximal amount of p-D-decoherence that is possible under these additional 
assumptions. 



2. Terminology 

Our terminology will be the same as in [7|, where the reader can find 
all relevant definitions. Here we will only clarify some key points that are 
crucial for understanding the formulation of our results. 

The symbol [N] denotes the set {1, . . . , N}, which is also the domain of 
iV-dimensional Boolean vectors s 6 2^. Each such s = (s\, . . . , sn) is the 
characteristic function of the set Ag C [N] = {i € [N] : Sj = 1}. It will 
sometimes be convenient to work with sets Ag instead of Boolean vectors s. 
Note that in this interpretation a Boolean function / is cooperative, which 
can be defined as preserving the coordinatewise partial order, if and only if 
it preserves the subset relation, that is, Ag C Ag * implies Af/g\ C Afrg *y It 
follows that every partial Boolean function on a set of pairwise incomparable 
Boolean vectors can be extended to a cooperative total Boolean function (see 
Proposition 2.1 of |7J); a fact that we will use several times. 

The symbol |s| denotes the number of coordinates i with Sj = 1; equiva- 
lently, |s| = \Ag\. 

The Hamming distance H(s,s*) between two Boolean vectors 
s = (si,..., sat) and s * = (s*, . . . , s* N ) with the same domain is the number 
of i with Si s*. Vectors with a Hamming of 1 are said to differ by a single 
bit flip. 

As in [7] and elsewhere in the literature, we will use the terms 'Boolean 
system' and 'Boolean network' interchangeably. But we will carefully distin- 
guish these dynamical systems from 'Boolean circuits' and 'Boolean input- 
output systems' which are layered arrangements of Boolean gates that calcu- 
late certain Boolean functions. Boolean input-output systems, as opposed to 
Boolean circuits, allow feedback loops between the variables; both structures 
can be incorporated as building blocks into Boolean networks to achieve de- 
sired dynamics. 

A Boolean input-output system is bi-quadratic if every of its variables 
has indegree and outdegree at most 2, where the indegree of a variable is 
the number of variables its regulatory function takes input from and the 
outdegree is to number of variables for which it serves as input. The system 
is strictly bi-quadratic if, in addition, every of its variables except the input 
variables has indegree exactly 2. Note that for Boolean networks the latter 
requirement already implies that each variable must have outdegree exactly 2 
as well (since the sum of indegrees in any directed graph is equal to the sum 
of outdegrees), but due to external inputs and outputs this implication is in 
general false for Boolean input-output systems. 
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3. Statement of the results 
For easier reference, we state the main result of part I [7]. 

Theorem 3.1. Given any < p < 1 and 1 < c < 2, for all sufficiently large 
N there exist p-c-chaotic, p-coalescent, N -dimensional bi-quadratic cooper- 
ative Boolean networks. 

3.1. Sensitivity to initial conditions. Our first formal definition of high 
sensitivity to initial conditions is the notion of p-instability that was intro- 
duced in [5]. A Boolean system is p-unstable if a random single-bit flip in 
a randomly chosen initial state moves the trajectory into the basin of at- 
traction of a different attractor with probability at least p. Note that for 
cooperative Boolean networks p-instability is the same as the negation of 
(1 — p)-coalescence: If s(0), s *(0) are two initial conditions that differ at ex- 
actly one variable, then we must have either s(0) < s *(0) or s(0) > s *(0); 
wlog assume the former. Then cooperativity implies that s(t) < s*(t) for 
all times t. If the inequality is strict for all t, then the two trajectories must 
reach different attr actors, since in cooperative Boolean networks every two 
states in a given attractor are incomparable (see, e.g., If equality holds 
for some t, then the two trajectories coalesce. 
We will prove 

Theorem 3.2. Given any < p < 1 and 1 < c < 2, for all sufficiently 
large N there exist p-c-chaotic and p-unstable N -dimensional bi-quadratic 
cooperative Boolean networks. 

Another hallmark of chaotic dynamics in Boolean networks is extensive 
damage propagation, which means that a small perturbation (such as a 
single-bit flip in an initial condition) tends to spread to a significant propor- 
tion of the nodes. The definition of p-instability does not account for this 
phenomenon. There are a number of possible ways to formally define exten- 
sive damage propagation; we will study here two such notions that require a 
significant proportion of nodes to be affected when the trajectories already 
have reached their attractors. 

Definition 3.3. Let D(N) be a function on the set of positive integer. An 
N -dimensional Boolean network exhibits p-D-decoherence if with probability 
> p a random one-bit flip s *(0) in a randomly chosen initial condition 
s(0) results in trajectories with the property that H(s(t), s *(t)) > D(N) for 
infinitely many times t > 0. In particular, if D(N) = aN for some constant 
a > 0, then we will refer to p-D-decoherence as p-a-decoherence. 

Note that p-a-decoherence means that for infinitely many t the Hamming 
distance will be at least a fraction of a of the size of the state space. Our 
next definition requires this to happen also sufficiently frequently. 

Definition 3.4. A Boolean network exhibits p-a-g-decoherence if with prob- 
ability > p a random one-bit flip s *(0) in a randomly chosen initial condi- 
tion s(0) results in trajectories with the property that for all sufficiently large 
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t* > 0, the proportion of times t S [0, t*] for which the Hamming distance 
satisfies H \s{t) , s * (t)) > aN is at least q. 

Note that p-a-g-decoherence implies p-a-decoherence, which in turn im- 
plies the negation of (1 — p)-coalescence, that is, p-instability. Thus in a 
sense, p-a-g-decoherence is the strongest possible form of sensitivity to ini- 
tial conditions. It turns out that this notion is still consistent with p-c-chaos 
in general, but not with cooperativity. 

Proposition 3.5. Let < a,p,q < 1 and 1 < c < 2. For all sufficiently 
large N there exist N -dimensional p-c-chaotic Boolean networks that are 
p-a-q-decoherent. 

Theorem 3.6. For every a > and < p < 1 there exists N a>p such 
that no cooperative Boolean network of dimension N > N a>p can have 
the property that for some fixed time t > with probability > p a single- 
bit flip in a randomly chosen initial condition leads to trajectories with 
H (s(t) , s * (t)) > aN. In particular, for any q > 0, no cooperative Boolean 
network of sufficiently large dimension can exhibit p-a-q-decoherence. 

Thus p-a-g-decoherence is a chaos-like property of the dynamics that 
is precluded by cooperativity. In contrast, the weaker property of p-a- 
decoherence is consistent with cooperativity and p-c-chaos at the same time. 

Theorem 3.7. Let 0<a,p<l<c<2. Then for all sufficiently large N 
there exist N -dimensional cooperative Boolean networks that are p-c-chaotic 
and exhibit p-a-decoherence. 



The networks constructed in our proof of Theorem 3.7 are not subject to 
any limitations on the number of inputs or outputs per variable and it is of 
interest to investigate how much damage progation is possible in bi-quadratic 
cooperative Boolean networks. We will give a proof of the following result. 

Theorem 3.8. Let < a < 0.5 and < p < 1 - 2a < 1 < c < 2 1 /^ 2a \ 
Then for all sufficiently large N there exist N -dimensional cooperative bi- 
quadratic Boolean networks that are p-c-chaotic and exhibit p-a-decoherence. 



While we do not know whether the bounds on a,p, and c in Theorem 3.8 
are optimal, we conjecture that there are some nontrivial bounds on these 
parameters in bi-quadratic cooperative networks, that is, we conjecture that 
the analogue of Theorem |3.7| fails for this class of Boolean networks. 



3.2. Strictly bi-quadratic networks. The theorems in [5] give upper 
bounds on c < 2 for c-chaotic, cooperative bi-quadratic Boolean networks 
that have a fixed positive proportion of strictly quadratic regulatory func- 
tions. In particular, if a network is strictly bi-quadratic, the bound is 10 1 / 4 
and it can be attained. The question is whether a similar result holds for p- 
instability. Here we will prove that the same bound is optimal for p-c-chaotic 
Boolean networks, that is, we will prove: 
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Theorem 3.9. Let < p < 1 and 1 < c < 10 1 / 4 . Then for all suffi- 
ciently large N there exist p-c-chaotic, p-coalescent N -dimensional strictly 
bi-quadratic cooperative Boolean networks. 

The question arises how much p-c-chaos and p-instability one can have 
simultaneously in a strictly bi-quadratic cooperative Boolean network. We 
will prove the following result: 

Theorem 3.10. Let 0<p<l<c< v3. Then for all sufficiently large 
N there exist p-c-chaotic and p -unstable N -dimensional strictly bi-quadratic 
cooperative Boolean networks. 



Note that \/3 < 10 1 / 4 . It turns out that Theorem 3.10 is optimal. In 
order to formally prove this, let us introduce some new terminology. 

Define qb(c,p) as the supremum of all q such that for all sufficiently large N 
there exists a strictly bi-quadratic cooperative p-c-chaotic TV-dimensional q- 
unstable Boolean network. 

Similarly, define q(c) as the supremum of all q such that for all suffi- 
ciently large TV" there exists a cooperative c-chaotic iV-dimensional g-unstable 
Boolean network in which all variables have indegree exactly 2. 

Since p-c-chaotic networks are automatically c-chaotic, for every p > the 



inequality qb(c,p) < q(c) holds. In this terminology Theorem 3.10 simply 
says that <#>(c,p) = 1 for all c < y/3 and p < 1. 

On the other hand, Theorem 5 of [5] says that for all c < 2 

Notice that on the interval [y/3, 2] the right-hand side of ([l| is a function 
that strictly decreases from 1 to 0.75. Since qb(c,p) < q(c), it follows that 
Theorem |3.10| is in some sense optimal. 

It may be of interest to investigate optimal bounds for qb(c,p) and related 
functions if v3 < c < 2. We wish to leave this as an open problem. 

We also don't know whether p-a-decoherence is possible at all, for 
any p, a > 0, in strictly bi-quadratic Boolean networks. However, a very 
slight weakening of it is still consistent in such networks, even in the presence 
of p-c-chaos. 

Theorem 3.11. Let 0<p<l<c< \/3. Then there exists a constant = 
@(p, c) > such that for all sufficiently large N there exist N -dimensional 
cooperative strictly bi-quadratic Boolean networks that are p-c-chaotic and 
exhibit P- Q^rm -decoherence. 

4. Damage propagation and ^-instability 
Here we prove all results that were announced in the previous section that 



do not require any knowledge of the proof of Theorem 3.1 The proofs of 
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Theorems 3.2 and 3.8 -3.11 rely to some extent on the construction that was 



used in [7] and will be given in the next section. 



Proof of Proposition 3.5: Fix a,p,q,c as in the assumption. Let iV be 
sufficiently large such that 

(2) c^ + l<l^V- 2 . 

It will be convenient for this proof to treat the states of B as subsets 
of [JV] instead of Boolean vectors. Let L be the integer that satisfies c N < 
L < c N + 1. Choose an indexed set A = {A e : I G [L]} with A e C [JV - 1] 
and define an updating function / for B as follows: 

f(Ai)=A t+l for£G [L-l]; 
f(A L )=A 1 ; 

f([N]\A e ) = [N]\A e+1 for £e [L-l]; 
f([N]\A L ) = [N]\Ar, 
f(B) = Ax if B n [JV - 1], [JV - 1]\B i A and \B\ is odd; 
f(B) = [N]\A! if B n [JV - 1], [JV - 1]\B $ A and \B\ is even. 

Note that A t / [N]\A e for all £,£'. 

Now consider initial conditions s(0), s *(0) where s(0) is randomly chosen 
and s *(0) is obtained by a random single-bit flip, and let B,B* be the sets 
of indices in [JV — 1] with Sj(0) = 1 and s*(0) = 1 respectively. By Q, with 
probability > p, neither of the sets 5n[JV-l], [JV — 1]\J3, B* n [JV— T], [JV- 
1]\J3* will be in ^4., and the last two clauses of the definition of the updating 
function / apply. Hence wlog f(B) = A\ and f(B*) = [N]\Ai. Thus at 
time 1 the system will have entered two different attractors of length > c N 
for these initial conditions, and we will have H(s(t), s*(t)) = N for all t > 0. 
□ 



(3) 



Proof of Theorem 3.6: Let a,p be as in the assumptions and let N a „ be 



the smallest positive integer JV such that for all k G [JV] 
t a\ ( k ) P a 

(4) W<T- 

Let B be a cooperative Boolean system of dimension JV > JV ajP . By 
symmetry we may focus in this argument on the case where a single bit is 
flipped from to 1. Fix t > and let r be the probability that a single-bit 
flip from to 1 in a randomly chosen initial condition leads to trajectories 
with H(s(t), s*(t)) > aN. Assume towards a contradiction that r > p. For 
each k G {0, . . . , JV— 1}, let p^ be the conditional probability that a single-bit 
flip from to 1 in a randomly chosen initial state s(0) given that |s(0)| = k 
results in trajectories with 



s 
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(5) H(s(t),s*(t))>aN. 

Note that in this case \s *(0)| = k + 1 and s(0) < s *(0). Cooperativity 
implies that 

(6) m<s*(t). 

Let L = {k: p k >l] and let K = {k : p k < \}. By (|4 



N-l /N\ /N\ /N\ , r , 

(7\ r < ST Pk ^k) _ ST Pk ^J , \- Mk) . \ L \P a , r 

{'J - 2 N 2 N ^ 2 N 2 2" 

fc=o fceL fceif 

Under the assumption r > p this implies 

(8) |i| = |{& : Pk > £}| > 

2 a 

Now consider a randomly chosen permutation it of [N], and let s fc,7r (0) 
be the characteristic function of the set {j : 7r(j) < k}. Define random 
variables X k such that X k (n) takes the value 1 if H(s k ' * (t] ), s fc+1 ' 7r (t)) > aN 
and takes the value otherwise. Let X = T] k =Q X k . Then E(X k ) = p k 
for all k and hence E(X) = >~2k=o Pk- By fek, E(X) > ^, and it follows 
that there exists at least one permutation it with X(tt) > — . But existence 
of such a permutation would require in view of ([5]) and ^ that there exist 
initial states s°> % (0) < s 1 '*^) < ■•• < s J ' w (0) with J > £ such that 
s 0,7T (t) < s 1,7T (t) < ■ ■ ■ < s J,7T (t) are characteristic functions of sets with 
Aj C A/+i C [N] and |^4j + i\j4j| > aiV, which leads to a contradiction. 

It remains to show how the first part of the theorem implies the sec- 
ond. Fix a,p,q as in the definition of p-a-g-decoherence. For each t > 
consider the random variable £t on the space of all pairs (s(0),s *(0)) that 
result from a random bit flip in an initial condition that takes the value 1 if 
H (s(t) , s * (t)) > aN and takes the value otherwise. The first part of the 
proof shows that as long as iV > N a ,pq we will have 

(9) Efo) = P(£ t = 1) < pq- 

Now fix t* > and let 77 = Y%=q &■ If holds, then 

qt*P{v > gf) < E{ V ) <pqf, 

and it follows that 



p(v>qt*)< P , 

which contradicts p-a-g-decoherence. □ 
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Proof of Theorem 3.7\ Let a,p,c be as in the assumptions. Fix the 
smallest positive integer z with p < 1 — 2~ z+2 , and fix 7 > and iV 7 > 2z 
such that the following inequality holds for all N > Ny. 

k=\N/2+jVN~\-l / 
(10) ^l>P + 2- Z+2 - 

k=\N/2-jVN]+l 

For N > iV 7 , let w := \N/2 - -y^N] and u := \N/2 + -yVN]. We will 
assume for sake of simplicity that u — w is even. 

By assumption, [2z] C [N]. The Boolean variables Sj with i G [2z] will 
play a special role in controlling cooperativity of the Boolean system that 
we are going to construct. 

Let Z be the set of all states s that satisfy the following conditions: 

3t G [z] 3j G [2z]\[z] Si = 1 & 8j = 0, 
^ 10 < |s| < u. 

Let iV > A^ 7 and consider a randomly chosen initial condition s(0) and 
any condition s *(0) obtained from it by a single-bit flip. The probability 



that the first line of (11) fails for s(0) or s *(0) is less than 2~ 2+2 , and (10) 
implies that P(u> + 1 < |s(0)| < « - 1) > p + 2" z+2 . It follows that with 
probability > p both s(0),s *(0) G Z. 

We will construct systems B of dimension N > iV 7 as follows. Let J = 
u — w. For each j £ J we will specify a periodic orbit Aj = : i G [L]} 

of length L > c^, where s J (i + 1) is the successor state in B of s^(i) for all 
i < L, in such a way that 

(i) s j (i) < si +1 (i) for all j G [J] and i G [L], 

(ii) s»'(t) t [z] = and ^'(i) f [2z]\[z] = 1 for all j G [J] and i € [L], 

(iii) tf(s^'(j),s j+1 C0) > aN for all j G [J], and 

(iv) for i 7^ i' and any j, j' G J the states s^(i) and s 3 ' («') are incomparable 
with respect to the coordinatewise partial order. 

This part of the construction defines a partial Boolean updating func- 
tion / of B on the set A = Uje[J] A?- By (i), (ii) and (iv) this function is 
cooperative. 

Note that by (ii), all states in A are incomparable with all states in Z. 
Thus if we define the restriction of the Boolean updating function / to Z so 
that it is cooperative, then automatically / \ (AL) Z) will be cooperative. 
Now consider s G Z. Then for a unique j G [J] we have |s| = w + j, and 
we define f(s) = s J (l). By (i), this construction results in a cooperative 
Boolean function on Z. Having defined a cooperative partial Boolean func- 
tion / \ (A U Z) we can extend it by Proposition 2.1 of (7| to a cooperative 
updating function / on the whole state space 2 N of B. 
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Now consider a random initial condition s(0) and let s *(0) be obtained by 
some one-bit flip in s(0). Then with probability > p both s(0),s *(0) G Z, 
and it follows that there are j,j' G [J] with |j — j'| = 1 such that s(l) = 
and s *(1) = s J (1). Wlog j' = j + 1 and condition (hi) implies that 
H (s(t) , s * (t)) > aN for infinitely many i, which gives p-a-decoherence. 

Note that when s(0) G Z, the trajectory of s(0) will reach one of the 
attractors Aj. In particular, (iv) implies that all s J (i) are pairwise distinct 
for different i and fixed j, thus Aj has length L > c n , and we get p-c-chaos 
as well. 

It remains to prove that for sufficiently large N we can construct a family 
A = {Aj : j G [J]} that satisfies conditions (i)-(iv). 

We need Nq > i\L sufficiently large so that for N > Nq we have 



(12) c N < 



( N-2(z + u-w) 
\\N/2] -(z + u-w] 



( u-w \ 

(13) > u - and 

\{u-w)/2J 

,ia\ N-2{z + u-w) 

(14) ^ ^ > a. 



Conditions ( 13 ) and ( 14 ) will be quite obviously satisfied for all sufficiently 



large N; condition (12) follows from the fact that we can make 2 N 2 ( z+u w ) 



larger than d N for any d < 2 and that { 2 ^) ~ ^7= as K — > 00. 

Fix N > N . Let U, W be disjoint subsets of [iV]\[2z] such that \U\ = 
\W\ = u — w, and let {aj : j G {0} U [u — w]} be a family of pairwise 
incomparable subsets of U. We can form this family from subsets of U of size 
(u — v) /2 each; condition ( |13[) implies that there will be enough such sets to 



choose from. Similarly, by (12) we can choose a family C = {q : i G [L]} of 
size L> c N of subsets of [N]\([2z]UUUW) that have size \ N/2] -(z+u-w) 
each and thus are pairwise incomparable. Let Wj for j G [u — w] be subsets 
of W such that Wj is a proper subset of Wj+i for all relevant j. 
Then define s 3 (i) as the characteristic function of the set 

• ai U U ([iV]\([z] U U U W)) if i < j < u - w, 

• ai U U [2z]\[z] if j < i < u — w, and 

• a U Wj- U Cj U [2z]\[z] if i > u - w. 

It is straightforward to verify that conditions (i)-(iv) hold, with the all- 



important condition (iii) following from (14). □ 

5. Proofs of Theorem [3J3 and l3^H3TT1 

The proofs of these theorems are based on the construction that was used 



in [7j for the proof of Theorem 3.1 and we will need to review it here to 
some extent. 
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Figure 1. A schematic view of the construction. 



Let 0<p<l<c<2beasin the assumptions of Theorem 3.1 In the 
proof we constructed, for sufficiently large N, a suitable updating function / 
for Boolean systems B = (2 , /) such that / was cooperative, bi-quadratic, 
and worked as required. The set of Boolean variables [N] was partitioned 
into a disjoint union [N] = X L)Y, where the set X in turn was a union of 
pairwise disjoint sets Xi, indexed by i £ I = {0, 1, . . . , \I\ — 1}, and all of the 
same size m < \I\. Both m and \I\ scale like y/~N. We singled out some 12 > 
i\ > io € I and conceptualized the collection of all sets Xi as a circular data 
tape, with / simply copying the vector sx i+1 (t) to sxi(t + 1) for all indices i 
with the exception of i G {io,h}, and also copying sx (t) to sx,,,^^ + 1). 
The vectors sx H (t + 1), sx i(i (t + 1) were outputs of special Boolean circuits 
E>2,Bi, which also took a second input from another Boolean input-output 
system B3. 

A schematic view of the construction is given in Figure 1. 

Although the figure suggests ^ Q, it will be convenient here to assume 
that iq — t\ + 1 = 0, so that Q = {0, 1, . . . io}. This amounts to a circular 
shift in the indexing and does not alter the construction in any way. 

Our proofs will rely on the following facts: 
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(PI) For sufficiently large N it is possible to construct these objects so 
that the resulting Boolean system will be cooperative, bi-quadratic, 
and exhibit p-c-chaos. 

(P2) For all i G I\{io,i\} and all t we will have = \sx z (t + 1)|- 

(P3) Each variable in X{ 2 +x has exactly one output variable in the system. 

(P4) With probability > p the trajectory of a randomly chosen initial 
condition will have the property that for every time t = k\I\ such 
that k is a positive integer, we have | (t) | = |Xj|/2 for all i G 
{«2 + 1, 12 + 2, . . . , \I\ — 1}. This follows from the choice of coding 
vectors in [7] and the workings of B\, B2, -B3. 

(P5) The ratio \Y U \J i<i2 X,i\/N approaches zero as N — > 00. 

The key requirement that makes this construction work for obtaining p- 
c-chaos is the following: 

(P6) With probability > p the following will hold for a randomly chosen 
initial condition: if t is any time of the form k\I\, where & is a 
positive integer, then with the possible exception of indices i £ Q, 
each vector (t) will be a coding vector, that is, will code an integer 
Vi(t) £ {0, . . . , n — 1} for some suitable value of n that depends on N. 
Moreover, again with the possible exception of % G Q, the function / 
computes addition of 1 modulo n — i on input X{ and writes the 
output to Xi after |/| steps. Formally, the latter means that for 
times t as above 



(15) V* G I\Q Vi(t + \I\) =Vi(t) + 1 mod (n-i). 

In order to make (P6) work, we will need a suitable n and, for each Xi, a 
set of coding vectors Cj C 2 Xi . The choice of the sets Cj will be restricted 
(in the sense of (P7a) below) by the particular coding scheme that we adopt 
in a given proof. For technical reasons the construction in needs 



(16) m = |Xj| = (1 + e) logn and |/| = /31og(n), 

where e > and f3 is a positive integer that does not depend on n. Note 



that (16) implies the scaling laws m = 0{yN) and |/| = 0{yN). Only the 
following additional properties of the coding are needed to obtain p-ochaotic 
systems: 

(P7) There are positive integers k, I with k depending only on c such that 
(P7a) d C (C k y, where C k is a set of Boolean vectors from 2 k , called 

the coding scheme, such that exactly half of their coordinates 

are l's (so the other half are 0's). 
(P7b) The pair (k, e) is c-friendly under the given coding scheme, 

which means that e is rational, is an integer, 



(17) 



log(c)(l + e) < 1, and 
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(18) \C k \ > 2 k / {l+£ \ 

A few remarks are in order here. Of course, the sets of variables Xi are 
pairwise disjoint, so we cannot literally make each Cj a subset of (Cfc) ; 
formally we will need disjoint copies of (C^) . However, we suppress the 
additional parameter to reduce clutter in our notation. The outputs of 
the Boolean input-output system B3 will also code for integers and satisfy 
property (P7), so our modifications of the coding scheme will apply to them 
as well. The wording chosen in [7] suggests that Ck is the set of all Boolean 
vectors from 2 k such that exactly half of their coordinates are Is, but this 



property was never actually used in the proof. Only ( 16 ) and property (P7) 
(which are taken from Section 8 of [7]) are ever referred to in any part of 
the construction. In fact, since we need exactly n codes for nonnegative 
integers, for most N not all vectors in (C&) are used even in [7j as actual 
codes. This makes it possible for us to alter the definition of Ck to more 
restrictive coding schemes that will work for our purposes here. 

For the description below, it will be convenient to consider a partition of 
each Xi into pairwise disjoint subsets x\ of size k each that correspond to 
the domains of the vectors in Ck when is coding. 

The system works as follows: With probability arbitrarily close to 1, for 
each i the vector sXi(O) will be crude, which means that there will be 
such that the restriction of (0) to x\ will take the constant value and 

the restriction of sXi(O) to x\ will take the constant value 1 (Lemma 9.1 
of [7J). For i £ {iq, io + 1, . . . , 12 — 1} these crude vectors will be eventually 
copied to Xi 2 , where they become inputs of the Boolean circuit B2, which 
eventually outputs a code for to X^ for each crude input. When given 
an input that is a coding vector, B2 outputs an identical copy of its input. 
The vector sx i2 becomes one of the inputs of the Boolean circuit B\ , which 
eventually outputs a code for v + 1 mod (n — w) to Xi if its input from Xj 2 
codes the integer v and the other input that it receives from B3 codes an 
integer w. With probability arbitrarily close to 1, the Boolean input-output 



system B3 will deliver the correct sequence of inputs to B± so that (15) of 
property (P6) holds. The set Q indexes those Xi for which the output of B\ 
may not be coding, due to the time lag in the calculations of B±, B2, B3. 



Proof of Theorem 3.9: We need to turn the networks constructed in [7J 
into strictly bi-quadratic ones. The main problem is that in the original 
construction each vector sx ; (t + 1) was supposed to be a copy of sx i+1 (t + 1) 
as long as i ^ {%q, Iq + 1, . . . , — 1}. This can be easily accomplished 
by a Boolean circuit B c of depth 1 with input variables Xi+i and Xi as 
output variables that uses only COPY functions, but there is no analogous 
strictly bi-quadratic cooperative Boolean circuit. Fortunately, as can be 
seen from the above description, it is not actually necessary that B c outputs 
identical copies of all possible inputs; it suffices that it does so whenever its 
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input sx l+1 is a coding vector. Since we may wlog assume that |/| is even, 
it even suffices to require that sx t (£ + 2) = sx i+2 (t) holds for all relevant 
indices i whenever sx i+2 (t) is coding. It turns out that there are strictly 
bi-quadratic cooperative Boolean circuits that work in this way for sets of 
coding vectors that satisfy property (P7) as long as c < 10 1 / 4 . 

We will also need that B c outputs crude vectors for crude inputs, so that 
B2 will receive the kind of inputs that are expected for random initial condi- 
tions. However, it follows immediately from the definition of crudeness that 
this will be automatically satisfied if B c is cooperative, strictly quadratic 
(thus uses only binary AND and OR gates), and such that all inputs for 
variables in x\ reside in x J i+1 , as will be the case in our constructions. 

Let us now present two coding schemes that allow for implementation of 
this idea. The first one will only be used in the proofs of some of our other 
theorems, but it is easier to understand and we want to describe it here as an 
illustration. Let AQ, Xi + \ be consecutively enumerated by n{i, A), + A), 
where A G [m]. Let Ck be the set of Boolean vectors s G 2 k such that «2k-i < 
S2k for all k G [k/2] and \s\ = k/2, and let Cj be the corresponding sets of 
codes in the sense of (P7a). Define B c ^ r = B c ^ r (Xi + i, Xi) as the Boolean 
circuit of depth 1 with input AQ+i, output AQ and regulatory functions 
defined by 



s«(i,2A-i)(* + !) = s re (i + i,2A-i)(*) A s«( i+1)2 A)(*) for A G [m/2]; 
S«(i,2A)(* + 1 ) = S«(i + 1,2A-1)(*) V S«(z+1,2A)(*) for A G [m/2]. 



Now it is clear from (19) that the Boolean circuit B CyT is strictly bi- 



quadratic and, as long as the sets x\ and x\ +l are consecutive intervals in 
Xi,Xi + i, it will copy s G Cj + i to its counterpart in Cj. Moreover, it will 
map crude vectors to crude ones. The circuit B c r has the additional useful 
property of mapping each s to f(s) such that |s| = regardless of 

whether or not s is coding. This will allow us to retain property (P2). For 
this reason we will call the coding scheme that we just defined robust coding. 

Lemma 5.1. Suppose 1 < c < Then there exist a rational e = e(c) > 
and a positive even integer k = k(c) such that the pair (k, e) is c-friendly 
under robust coding. 

Proof: Let e be rational, such that is an integer, and 

(20) log(c) < ^ < log(V3). 

Such e exists by our assumption on c, and ( [20] ) implies ( |l~7"| ). 

Fix an even integer k. We can think about the vectors s G as outcomes 
of the experiment of randomly and independently drawing (s2k-i < S2k) 
from the set {(00), (01), (11)} with the uniform distribution. Then \s\ is a 
random variable with mean E(s) = k/2, and the space of all possible out- 
comes has size 3 fc//2 . The Central Limit Theorem implies that the probability 
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of obtaining a vector in C^, that is, an outcome with |s| = k/2, scales like 
k-°- 5 . Thus by (20) we have for some constant p > and for sufficiently 



large k 

(21) \C k \ > p3 fc / 2 -0-51og(fe) > 2 */(l+e) j 



and ( 18 ) follows. □ 



The coding scheme that we will actually use in the proof of Theorem 3.9 
is more complicated and we will refer to it as subtle coding. The relevant 
sets Cfc and the corresponding Boolean circuit B c<s (Xi+i, Xj) were implicitly 
described in detail in Section 4.2 of [5] and Section 3 of |6j, and we refer the 
reader to these publications for details. Here we only want to record the key 
properties that will be used in our arguments. 

Lemma 5.2. (a) Suppose 1 < c < 10 1 / 4 . Then there exist a rational e = 
e(c) > and a positive even integer k = k(c) such that the pair (k, e) is 
c-friendly under subtle coding. 

(b) There exists a strictly bi-quadratic Boolean circuit B CtS (Xi+i, X{) of 
depth 1 such that if is a coding vector under the subtle coding scheme, 
then the concatenation £? C)S (Xj + i, Xj)o_B C)S (JTj + 2> -^i+i) outputs an identical 
copy of sx i+2 after two steps and writes it to the variables in X{. 

Proof: For the proof of part (a), choose c\ with c < c\ < 10 1//4 . Lemma 3.1 
of [6] states (in a slightly different terminology) that for sufficiently large k 
that are divisible by 8 we will have \C^\ > c\. Now let e be a rational such 
that yqj^ is an integer, and 



(22) log(c) < — < log( Cl ). 



Then 



(23) \C k \ > p4 > 2 k ^ 1+£ \ 

as required. 

For the proof of part (b) we refer the reader to [5] or j6] . □ 
Unfortunately, subtle coding does not preserve \s\. Thus in the proof of 



Theorem 3.10 we will use robust coding instead. Moreover, the output vector 
f(s) of B c>s is not usually an exact copy of s even if s is coding. However, 
applying the operation twice produces a copy / o f(s) of s whenever s is 
a subtle code. This is sufficient for our purposes; as we already mentioned 
above, we only need that sxi(t + 2) is a copy of sx t+2 {t) for all relevant i 
and t. 



Lemmas |5.1| and 5.2 imply that instead of straight copying in the con- 



struction of [7] we can use the circuits B c ^ r with robust coding for all 
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0<p<l<c<\/3or B c , s with subtle coding for all < p < 1 < c < 10 1 / 4 . 
This will not affect the other technical arguments of the construction in [7] 
and give us p-c-chaotic systems. Alas, it will not give us all by itself strictly 
bi-quadratic networks. We need to alter the construction in such a way that 
every variable has exactly two inputs and exactly two outputs. If we use ro- 
bust or subtle coding, then this will be true for the variables in the relevant 
sets Xi, but not automatically for the variables in the remaining parts of 
the system, in particular, for the variables in B\, B<i, B%. We need a tool for 
adding redundant inputs to some variables that will not substantially alter 
the long-range dynamics of the whole system. The following lemma gives us 
such a tool. 

Lemma 5.3. For every < q < 1 there exists a Boolean system B q of depth 
d = [~log(— log(l — q))~\ with < 2\— log(l — q)~\ variables that satisfies the 
following. Except for one variable i q whose indegree is 1, the indegree of 
every variable is 2, and, except for one variable o q whose outdegree is 1, the 
outdegree of every variable is 2. Moreover, with probability > q the value 
of o q will be 1 at all times t > d, regardless of the initial values of all the 
variables in B q , and the trajectory of i q . 

Proof: Let q be as in the assumption and let d be as in the statement of the 
Lemma. It will be convenient to let the variables of the system be binary 
sequences a of length at most d, where o q is the empty sequence, and i q is 
the zero sequence of length d. The sequences of length d will constitute the 
lowest level 1 of the variables of the system. For a of length < d we let 



(24) s (T (t+l) = s a ~ (t)Vs a ~ 1 (t). 

It is easy to see that the total number of variables on levels > 1 is 2 d — 1. 
Therefore, there exists a bijection <p between all the variables on level 1 
except for i q , and the variables on higher levels. For variables a on level 1 
that are distinct from i q we define 



(25) s a (t + l) = s a {t) V^)(t), 

and we let Si q (t + 1) = Si q (t). 

Thus the variable o q will take the value at time d only if s a (0) = for 



all a of length d, and the self-input in (25) assures that the same applies 
to all t > d, regardless of the trajectory of the variable i q . Now the lemma 
follows from our choice of d. □ 

Observe that in bi-quadratic Boolean networks, if there exists a variable 
x whose outdegree is < 2, then there must exist a variable y whose indegree 
is < 2. Therefore, we can add to our system a copy of B q by defining new 
regulatory functions that connect x to i q and o q to y using the conjunction 
regulatory functions, and keep repeating this procedure until there are no 
variables with outdegree < 2. If there are no such variables left, then, clearly, 
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there are no variables with the indegree < 2 either. Moreover, since with 
probability > q any external inputs to any of the copies of B q will have no 
effect on the output of B q , the arguments in the proof of [7J carry over to 
the modified system. 

It remains to check that we will not add too many variables in this way, 
and that copies of B q will start producing value 1 at o q sufficiently fast 
(so they don't affect the workings of B). The total number of variables 
in the Boolean input-output systems B\,B2, B% can be made to scale like 
0((log(n)) L5 ). Unfortunately, this was not explicitly stated in this form 
in [7J, since for the construction to work, we only needed that the total 
number of variables in the set Y = [N]\X is bounded from above by a fixed 
constant times (log(n)) 2 (see (10) of [7J). But for B% the stronger scaling 
law follows from the formulation of Lemma 10.4 of [Tj; for B\ and B2 it 
follows from the proofs of Lemmas 5.1 and 5.3 that are given in [7J. 

For a fixed q' = 1 — x < 1, we need to choose q < 1 such that with 
probability q' each of the copies of B q will start generating the value 1 at 
their variables o q . This will be true for q > (g / ) 1 /( cl °s( n )) 1,5 ; where c > 
is a constant such that + I-B2I + I-B3I < (clog(n)) 15 . If we let q = 



1 — n — } ui s x, then 



(clog(n)) 1 - 5 



> 1 -x. 



For this choice of q, by Lemma 5.3 the number of variables in each copy of 



B q is at most 

— log(l — q) = (1.5)clog(log(n)) — log(x) < c log(log(n)) 

for some constant d > 0, and the total number of new variables will scale 
like 

0((log(n)) 1 - 5 log(log(n))), 

which is in compliance with (10) of [JJ. 

Now the modified system will, with probability > q' , work exactly like the 
original system for all times t > d, where d = 0(log(loglog((ra))) is the depth 
of the circuit B q . The first d steps where B\ and B2 may work improperly 
have only the effect of slightly increasing the size of the set Q, but not by an 
order of magnitude (recall that Q was the set of those indices i for which the 
corresponding Xi was the output of B\ before everything started working 
properly) . 

With the input-output system B3 we need to proceed somewhat more 
carefully, since it needs to work properly right from the beginning. Recall 
that in the construction of B3 given in Section 10.3 of [7J, the regulatory 
functions at the lowest level were already strictly quadratic. The next levels 
were designed to produce an ordered version s a of the output S£ of the lowest 
level, with |s D | = \se\ and all zeros in s Q preceding all ones. We quoted a 
construction from [lj and it is not clear from the quoted result whether this 
part of the system is strictly quadratic. 
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The number of such variables in B3 that might take only a single input 
does not exceed the overall size of B3, which is 0((log(n)) a ) for every a > 1 
by the paragraph preceding Lemma 10.4 of |7j. Thus we can add 0(log(n) 1-1 ) 
copies of the circuits B q of depth d q = 0(log(A)) = 0(log(log(n))) with a 
total of 0((log(n)) 15 ) variables to give second inputs to these variables. 
Moreover, we can add d q levels above the lowest one and use the strictly 
bi-quadratic Boolean circuit B c ^ r for robust coding to produce a version of 
the lowest level that will preserve its size and will be available for further 
processing by the original system once all the variables o q that are to be 
used in modifying the subsequent levels have reached their target value 1. 
This again requires adding at most 0(|i?3| log(iV)) = 0((log(n)) L5 ) new 
variables and does not violate our restrictions on the size of the set Y of 
variables outside the union of the sets Aj. 

In order to get systems of size exactly N for all sufficiently large N we 
may need to add also some dummy variables (see [7J for an estimate of the 
size of this set), but these can simply be connected among themselves with 
AND gates and they don't have any influence on the overall dynamics. 

In particular, using subtle coding together with the modifications outlined 
in the last few paragraphs gives us networks that satisfy the conclusion of 
Theorem EU □ 



Proof of Theorems 3.2 and 3.10 Fix 0<p<l<c<2, and an 



auxiliary constant c\ with c < c\ < 2. For the proof of Theorem 3.10 we 
make the more stringent assumption that c < c\ < y3. We will show that 
as long as N is sufficiently large, there exists a p-c-chaotic and p-unstable 
A-dimensional bi-quadratic cooperative Boolean network. Our strategy will 
be to first choose some N± < N and an Ai-dimensional Boolean system Bi = 
(2 Nl ,f) that is p-ci-chaotic. We can assume that Bi has been constructed 
as above and has properties (P1)-(P5). For the proof of Theorem 3.10 we 
will assume in addition that Bi is strictly bi-quadratic and uses the robust 
coding scheme. We will construct an extension B = (2 N , g) of Bi so that 
9j = fj f° r an 3 ^ [-^1] ano - no variable i n [Ai] takes input from any variable 
in [A]\[Ai]. In the proof of Theorem 3.10 we will make an exception for 
variables i q of some copies of B q of Lemma 5.3 that will receive a second 
input from [A]\[Ai]. This provision will preserve the property of p-ci-chaos 
in Bi, in the sense that with probability > p a randomly chosen trajectory 
will reach an attractor of length > c^ 1 . Note that this implies p-c-chaos in B 



as long as c^ 1 > c N , or, equivalently, 



N 



Nx lnc 

(26) — > . 

K 1 N ~ lnci 



For a given N, let N\ = We will first present a construction 

of the extension B of Bi. At the end of the proof we will argue that for 
sufficiently large the number of required new variables is sufficiently small 
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so that there is enough room for them in [iV]\[iVi]. The regulatory functions 
for the variables in [iV]\[iVi] will be chosen in such a way that the system 
detects and keeps a permanent record of a proportion of > p of all single- 
bit flips in the initial conditions. Having a ratio ~ 1 again is very 
helpful here, since it assures that most of these single-bit flips will occur 
at variables in Ni, and property (P5) in turn implies that we may restrict 
our attention to those single-bit flips that happen at some variable j G Xi 
for i > %2- Notice that any such single-bit flip changes |sjq(0)| for some 
i > i%. By Property (P2), which is preserved under robust coding, and by 
induction we will have |sx 4 (0)| = \sx i2+1 (i — i>z — which allows us to 
construct the extension in such a way that the only variables in N\ that 
send input to any of the variables in [iV]\[iVi] are the ones in Xi 2+ \. If 
Bi is based on the original construction in [JJ, Property (P3) allows us to 
copy sx i2+1 (t) to a Boolean vector sp(t + 1) whose set of variables P is 
contained in [iV]\[./Vi]. For the proof of Theorem 3.10 we need to assume 
that Bi is strictly bi-quadratic and has been constructed as in the proof of 
Theorem |3.9[ but with robust instead of subtle coding. Recall that in this 
construction each variable in Xi 2 +i acts as a second input to a variable i q 
at the lowest level of some copy of B q . We need to change these outputs to 
variables in [iV]\[iVi] and reassign new second input variables from [iV]\[iVi] 
to the newly orphaned variables i„. As we already know, this operation is 
not expected to alter the relevant dynamical properties of Bi. 

Let u = u{p) be a fixed positive integer whose meaning will become 
apparent shortly. Now we can incorporate a Boolean circuit B4 into Bi 
whose set of variables is contained in [iV]\[iVi] that takes sp as input, 
produces u copies of it and writes its output to vectors Sq for w G [u] 
of the same dimension after steps so that for all w G [u] we have 

\s Xl2+1 (t)\ = l s H* + 1)1 = \ s ott + 1 + d ±)\ and a11 zeros in l s o(* + 1 + d ±)\ 
precede all ones in this vector. We already know from Proposition 10.1 and 

the proof of Lemma 5.2 of [7] that this can be accomplished by a cooperative 

bi-quadratic Boolean circuit of depth d < 74 log(m) that contains a total of 

74?7ilog(m) variables, for some constant 74 that is independent of N, where 

m is on the order of \/N~. 

We would like to create and keep a permanent record of the values of 
SQ(t + 1 + di) for all times t < \I\ — i<i- If this can be done, then the 
permanent record will persist throughout the attractor, which implies that 
every single-bit flip in an initial condition that happens at some variable 
j G Xi for i > 12 will move the system to a different attractor. We would 
like to keep this record in circular data tapes of Boolean vectors (sz™ '■ i G I) 
so that for t > 1/1 + d± and for all w G \u] we have sz w (t + 1) = sz w (t) and 
also sz™ i (t + 1) = sz™(t), with the tape holding copies of Sq(£ + 1 + ^4) 
in szf t (|/| + di) at time |/| + d/± for all 1 < t < \I\. 

There are several technical problems with implementing this idea in its 
original form. First of all, in order to not use too many new variables, we 
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will actually record only a part of the values of variables o\ , . . . , o m from 
O. For the time being, let us just say that we will choose some j, J with 
1 < j < m/2 < J < m, and keep track of variables Oj, . . . ,oj only. The 
values of j, J will be selected in such a way that the difference between s(0) 
and its single-bit flip s* (0) will be visible with sufficiently high probability in 
the window Oj, Oj+i, oj after placing all zeros before all ones in s(0), s*(0). 

In order to record anything in a circular data tape, for some i* the vari- 
ables in Zf, need to take a second input from variables in O in addition to 
the input from Z™ +1 that will be responsible for the copying of the tape. 
For our accounting to work as specified above, we need i* = 12 + 1, but it 
will be more convenient to write i* . 

This leads to our first technical problem: we need to make sure that the 
relevant data that has been transferred (regardless of how it is done) from 
O to Zf, at times (I4 < t < (I4 + \I\ are not erased at subsequent times. 
Let us for the time being assume for simplicity that u = 1, which allows 
us to drop confusing superscripts w; the solution to the first problem has a 
straightforward generalization to u > 1. Enumerate the variables in Z{* as 
Zj, Zj+i, . . . , zj, the variables in Z{* + i as z^~, z~^ +l , . . . ,z~j and define: 



(27) 



Xt + 1) = s z +(t) Vs OM (t) for j<fJ,<m/2, 
(i + 1) = s + (t) A s OM (t) for m/2 < fi < J. 



This definition assures that if \sp\ = m/2, which is true for all times 
t > \I\, then the input from the variables in O has no effect whatsoever, 
since in this case the first half of the variables of O evaluate to and the 
second half to 1. In particular, by property (P4a) this will be the case, with 
probability > p, whenever O records the size of a vector sxi(k\l\) for some 
k > 1 with i > %2- 

Unfortunately, this definition does not warranty that exact copies of so 
will be transferred to Z^. Let us focus on the case where j < [i < m/2; 
the argument for the case of \i > m/2 is dual. Each value s Q (t) = 1 gets 



faithfully copied to s z „(t + 1) = 1, but the updating as specified by (27) will 
also introduce some random occurrences of s z (t + 1) = 1 while s Tt) = 0, 
due to s +(t) = 1. But consider a situation where the s +(t) are random and 



we want to use ( 27 ) to record to the data tape the sizes of some sx t (0) , s* x . (0) 
for i > 12 , as coded by the Boolean variables s 0ll (t) , that differ by a single-bit 
flip and are such that j < |sXi(0)| = fi < fi + 1 = |s^.(0)| < J. 

However, as long as s z +(t) = 0, a 1 will be copied to s Z)i (t + 1) only for 
the trajectory of the corresponding s *(0), but not for the trajectory of s(0). 
If this happens, the two trajectories will reach different attractors and we 
will say that our recording tape successfully distinguishes these two initial 



conditions. In the proof of Theorem 3.2 we can assume that s + (t) takes 

I I M 

the value with probability 0.5, which therefore is the probability that a 
given recording tape will successfully distinguish the two initial conditions 
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as specified. These events are independent for the u data tapes, thus by 
choosing u large enough so that 0.5" < 1-pwe can assure that the prob- 
ability of success in at least one recording tape is > p, which is all we need 
for p-instability. 

The third problem we need to take care of is to choose the values of j, J. 
We need that with probability > p we will have 



(28) 



j< \s%(t + l + d 4 )\ < J 



as long as Sq (t + 1 + d±) records the size of some 5^(0), so that a random 
single-bit flip in this vector can alter the permanent record. By the Central 
Limit Theorem and Chebysheff 's Inequality, this can be achieved, for suffi- 
ciently large N and hence m, if j < m/2 — 75-v/m and J > m/2 + 75 y/m for 
some constant 75 that depends on p, but not on m. Since u does not depend 
on N and m = 0(yN), using such j, J we will be able to construct recording 



3/4 



variables. For 



tapes that altogether use on ly on the order of Uy/m\I\ or N x 
the proof of Theorem 3.10 we will also need 0{NJ ) copies of the Boolean 
input-output system B q , where q can be chosen as 1 — j^. This will add 

another 0{N^ i log(iVi)) variables. By connecting these as in the proof of 
Theorem |3.9| to achieve a strictly bi-quadratic network. The modification of 
all monic regulatory functions of the circuit B4 and the data record tapes 
may result in missing a few single-bit flips in sx;(0) for 12 < i < 12 + d 
that Bi detects, where d is the depth of B q , but this is no problem, since 
d = 0(log(iVi)) is very small relative to |/|. In either case, the total number 
M of variables in IB does not exceed N, provided that N is sufficiently large. 
If M < JV, we add to B some dummy variables and connect them as in the 



proof of Theorem 3.9. These dummy variables will not destroy p-instability 
ofB. □ 



Proof of Theorems 3.8 and 3.11 : For the proof of Theorem 3.8 , fix 
< a < 0.5, 0<p<l-2a<l<c< 2 1 ~ 2ct ; for the proof of Theorem^. 11 



fix0<p<l<c< \/3. We will show that as long as N is sufficiently large, 
there exists a p-c-chaotic ^-dimensional (strictly) bi-quadratic cooperative 
Boolean network with the required decoherence property. Similarly to the 
previous proof, our strategy will be to first choose some N\ < N and an 
N\ -dimensional Boolean system Bx = (2^, /) that is constructed as in the 
previous proof and satisfies the conclusion of Theorem |3.2| (in the case of 
the proof of Theorem 3.8) or Theorem 3.10 (in the case of the proof of 
Theorem 3.11) for some auxiliary constants p\ and c\. For Theorem |3.8 
we will choose p\ = 1 _ p 2q and c\ = c 1 ^ 1-2 "^ and for Theorem 



choose any p\ with p < p\ < 1 a nd c\ with c < c\ < 
In the proof of Theorem 



3.11 



we will 



3.8 



we will construct an extension IB = (2 N ,g) 
of IB so that gj = fj for all j £ [Aq] and no variable in [Ni] takes input from 
any variable in [iV]\[iVi]. This latter provision will preserve the property 
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of pi-ci-chaos in Bi, in the sense that with probability > pi a randomly 
chosen trajectory will reach an attractor of length > c Nl . Moreover, p\- 
instability of Bi will be preserved in the sense that a proportion of > p\ 
of single-bit flips in initial conditions that occur at variables in \N\\ will 
result in trajectories th at re ach different attractors. However, in contrast 
to the proof of Theorem |3.2| we will no longer aim for making the ratio j^- 
arbitrarily close to 1; instead, we will choose N\ = — 2a)N~\ , which gives 



(29) 



Ni 
N 



1 - 2a. 



This has two important consequences that are reflected in the statement 

i will guarantee at most c\~ 2a - 



of Theorem 
chaos in B, 



3.8 



First of all, ci-chaos in 
which is the same as c-chaos by our choice of c±. Second, the 
proportion of single-bit flips in initial conditions that occur in variables 
in iVi is at most 1 — 2a. Thus pi-instability in Bi translates at most into 
(1 — 2a)pi-instability in B, that is, p-instability. 

In the proof of Theorem 3.11 we will need to alter some regulatory func- 
tions in Bi for the variables i q of some copies of B q , as we did in the proof 



of Theorem 3.10 By the same argument as in the previous proof, this is 
not expected to alter the essential features of the dynamics of Bi. We will 

which ensures, by the same argument 

that B will be p-c-chaotic and 



choose N\ = [max | 



In c 
lnci ' 



as in the proofs of Theorems |3.2| and 3.10 
p- unstable. 

Thus in both constructions, a random single-bit flip in a randomly chosen 
initial condition will leave a permanent record in at least one of the data 
record tapes of Bi. Let Zf be as in the proof of Theorems 3.2 and 3.10 
Let z™ denote the /i-th element of . By the construction in the proof 
of Theorems 3.2 and 3.10 and our choice of the ratios N\/N,p/pi, we can 
conclude that if s(0),s *(0) are two randomly chosen initial conditions of B, 
then with probability > p the following will hold: 



(30) 3t ,/x e [J-j + l],w £ [u]Vk > s^(t + k\I\) ± s* zW (t + k\I\), 

where Sj(t), s*(t) denote the values of variable i at time t in the trajectories 
of s(0),s *(0) respectively. 

The next step in the construction is to add a Boolean input-output sys- 
tem Bq to Bi that copies the values of the variables z™ at selected times to 
a single variable k* so that (30) will imply 



(31) Vt3t+ >t s k *(t + )^s* k *(t + ). 

Let (J — j + l)u < T < \I\ be a prime number. Since ( J — j + l)u = 
0(\/|Tj), by the Prime Number Theorem, such T exists for sufficiently 
large N. Let v : ([J]\[j — 1]) x [u] — > [(J — j + l)u] be a bijection. For each 
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[i G [J— andto S [u] define a vector f^w S 2 of length = (J— j+l)u 
that takes the value 1 only on its ^(/z, u;)-th coordinate r v r^ w \ and takes the 
value otherwise. Lemma 10.4 of [7] implies the existence of a Boolean 
input-output system with output vector f E 2 R such that with probabil- 
ity arbitrarily close to 1, 



(32) V(m,u>) G - 1]) x [u^t^Vfc G N r{t^ w + fcT) = f^ w . 

Moreover, requires adding only 0((J — j + l)itTlog((J — j + l)uT)) = 

O(iV 3 / 4 log(A0) variables. 

Create a new set of variables R* with \R*\ = \R\ and define regulatory 
functions for the Boolean vector r* with this domain by 



( 33 ) r t(v,w) (* + !) = r K^) A s ^ (*) • 

Make k* the output of a Boolean circuit Bq that calculates the conjunction 
of all the variables in R* . Since T is relatively prime with \I\(J — j + 
this guarantees that the value of each variable in the union of all data tapes 



will be copied infinitely often to k* and gives the implication (30) ( |3l[ ). 

Finally, for the proof of Theorem |3.8| we add another Boolean circuit Bj 
to Bj that is composed of variables in [iV]\[iVi] and copies the value of its 
single input variable k* to \aN~\ distinct output variables after dj time steps. 
By Proposition 10.1 of [7], there exists a cooperative bi-quadratic Boolean 
circuit that accomplishes this task and uses at most 2[aiV] variables. Thus 
the addition of Bj does not allow us to achieve a higher ratio than in 



in ( 29 ) . But since By is the most expensive part of the construction in terms 
of the number of necessary additional variables; the ratio can be arbitrarily 
close to 1 — 2a. 

Let us recapitulate how this construction ensures p-a-decoherence. A 
random single-bit flip s * (0) in a randomly chosen initial condition s(0) 
happens with probability ~ 1 — 2a at a variable in [N\]. By the proof of 



Theorem 3.2, with probability that can be chosen arbitrarily close to 1, it 
will leave a permanent record in at least one of the data record tapes in N±. 
This record will result in infinitely many times t + where the trajectories 



differ at variable k*, as in (31). This difference in turn will be amplified 



by By to \aN~\ distinct varia bles, and p-a-decoherence follows 
For the proof of Theorem 



Bj will copy k* only to e i<^( jy) distinct 



3.11 

output variables, where will be determined shortly. This will ensure p- 
-decoherence as in the previous paragraph and requires adding at 



N 



eiog(AT) 

most g iflpn variables. The resulting system will not yet be strictly bi- 
quadratic; we will need to add copies of the Boolean circuits B q where 
1 — Q < w an d connect their respective output variables o q by conjunctions 
to variable j G Bq U By with monic regulatory functions. This requires 
adding ^ + 0(iV 3 / 4 log(JV) log(log(iV))) new variables. By choosing B large 
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enough so that ^ <C (1 — 2a) N we don't exceed the allotment of N — N\ 
additional variables specified by (29). Finally, we add dummy variables if 
needed, and connect variables that have fewer than 2 outputs to variables i q 
of copies of B q . The resulting system will have the properties specified in 
Theorem 13.111 □ 



6. Conclusion and future directions 

In this paper and its prequel [7] we studied the problem whether cooper- 
ativity, that is, the total absence of negative interactions, precludes certain 
types of chaotic dynamics in Boolean networks, at least under additional as- 
sumptions on the number of inputs and outputs per node. This is a natural 
question in view of the analogous result for continuous flows that was men- 
tioned in the introduction, and the well-known fact that Boolean networks 
with few inputs per node tend to have ordered dynamics. 

Chaotic dynamics of Boolean networks is characterized by very long at- 
tractors, very few eventually frozen nodes, and high sensitivity to perturba- 
tions of initial conditions. While these three hallmarks usually go together, 
the answer to our question crucially depends on how chaos in Boolean net- 
works is formalized. The notion of p-c-chaos formalizes genericity of very 
long attractors and also implies genericity of very few eventually frozen 
nodes. We showed that cooperativity does not impose any nontrivial bounds 
on this property, even in bi-quadratic Boolean networks. Similarly, in strictly 
bi-quadratic networks, cooperativity does not imply additional bounds on 
p-c-chaos beyond the previously known bound of c < 10 1//4 for c-chaos. 

However, the situation changes when one considers notions of high sensi- 
tivity to perturbations of initial conditions. The strongest such notion con- 
sidered here, p-a-g-decoherence, while still possible in p-c-chaotic Boolean 
networks in general, is outright precluded by cooperativity. The weakest of 
these three notions, p-instability, is still consistent with p-c-chaos in coop- 
erative bi-quadratic Boolean networks for all0<p<l<c<2. But if in 
addition it is assumed that the network is strictly bi-quadratic, a stronger 
bound c < v3 applies, and the bound is strict. 

The notion of p-D-decoherence comes in many flavors, depending on the 
parameter D. While it is consistent with cooperativity and p-c-chaos for all 
0<p<l<c<2 and all meaningful linear D in general, we were only 
able to construct bi-quadratic and strictly bi-quadratic Boolean systems 
that satisfy this property under some additional restrictions on p, c, and D. 
Since any form of p-ZJ-decoherence implies p-instability, there must be some 
such restrictions at least under the additional assumption that the system 
is strictly bi-quadratic. We conjecture that there are some restrictions for 
bi-quadratic systems as well. However, it remains an open problem to find 
the optimal upper bounds on the amount of p-c-chaos and p-D-decoherence 
that can simultaneously occur in such networks. 
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Thus cooperativity, by itself and in conjunction with suitable restrictions 
on the interactions of the variables, does impose restrictions on how much 
chaos is possible in a Boolean network. These results can be interpreted as 
counterparts of the corresponding theorem for flows. Our work shows that 
valid results of this kind require very specific conceptualization of certain 
hallmarks of chaotic dynamics. We believe that these subtleties need to be 
well understood if researchers are to make valid inferences from dynamical 
properties of a Boolean approximation to an ODE model of a natural system 
about the ODE dynamics or the behavior of the natural system itself. 



[l 

[2 

[3; 

K 

[5 

ir 

[9 

[10: 
in 



References 

M. Ajtai, J. Komlos, and E. Szemeredi; Sorting in c log n parallel steps. Combinatorica 
3, 1983, 1-19. 

M. Aldana, S. Coppersmith, and L. P. Kadanoff; Boolean Dynamics with Random 
Couplings. In Perspectives and Problems in Nonlinear Science, E. Kaplan, J. E. Mars- 
den, and K. R. Sreenivasan, eds., Springer Verlag, 2003, 23-90. 

G. Enciso, M. Hirsch, and H. Smith. Prevalent behavior of strongly order preserving 
semiflows. J. Dyn. Diff. Eq. 20, 2008, 115-132. 

G. A. Enciso and W. Just; Analogues of the Smale and Hirsch theorems for co- 
operative Boolean and other discrete systems. Journal of Difference Equations and 
Applications 18, 2012, 223-238. 

W. Just and G. A. Enciso; Extremely Chaotic Boolean Networks. arXiv:0811.0115vl, 



2008. Available at http://arxiv.org/abs/0811.0115 



W. Just and G. Enciso; Exponentially long orbits in Boolean networks with ex- 
clusively positive interactions. Nonlinear Dynamics and Systems Theory 11, 2011, 
275-284. 

W. Just and M. Malicki; Cooperative Boolean Systems with Generically Long Attrac- 
tors I. Journal of Difference Equations and Applications, to appear. Preprint available 
at |http://arxiv.org/abs/1302.3008"l 

B. Drossel; Random Boolean Networks. In Reviews of nonlinear dynamics and com- 
plexity, volume 1, H. G. Schuster, ed., Wiley- VCH, 2008, 69-110. 
M. Hirsch; Stability and convergence in strongly monotone dynamical systems. Peine 
und Anqew. Math. 383, 1988, 1-53. 

S. A. Kauffman, Origins of Order: Self-Organization and Selection in Evolution, 
Oxford U Press, 1993. 

H. Smith; Monotone Dynamical Systems: An Introduction to the Theory of Compet- 
itive and Cooperative Systems. AMS, 1995. 



Winfried Just: Department of Mathematics, Ohio University, Athens, OH 
45701, USA, Maciej Malicki: Institute of Mathematics of the Polish Academy 
of Sciences, Sniadeckich 8, 00-956, Warsaw, Poland 

E-mail address: mathjust@gmail.com, mamalicki@gmail.com 



